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Abstract 

We  consider  a  model  of  a  multipath  routing  system,  where  arriving  customers  are 
routed  to  a  set  of  identical,  parallel,  single  server  queues,  according  to  balancing  poli¬ 
cies  operating  without  state  information.  After  completion  of  service,  customers  are 
required  to  leave  the  system  in  their  order  of  arrival,  thus  incurring  an  additional  rese¬ 
quencing  delay.  We  are  interested  in  minimizing  the  end-to-end  delay  (including  time 
at  the  resequencing  buffer)  experienced  by  arriving  customers.  To  that  end,  we  es¬ 
tablish  optimality  of  the  Round-Robin  routing  assignment  in  two  asymptotic  regimes, 
namely  heavy  and  light  traffic:  In  heavy  traffic,  Round-Robin  customer  assignment  is 
shown  to  achieve  the  smallest  (in  the  increasing  convex  stochastic  ordering)  end-to- 
end  delay  amongst  all  routing  policies  operating  without  queue  state  information.  In 
light  traffic,  and  for  the  special  case  of  Poisson  arrivals,  we  show  that  Round-Robin  is 
again  an  optimal  (in  the  strong  stochastic  ordering)  routing  policy.  We  illustrate  these 
and  suggest  other  stochastic  comparison  results  in  a  number  of  simulation  examples. 

*This  work  was  prepared  through  collaborative  participation  in  the  Communications  and  Networks  Consor¬ 
tium  sponsored  by  the  U.  S.  Army  Research  Laboratory  under  the  Collaborative  Technology  Alliance  Program, 
Cooperative  Agreement  DAAD 19-0 1-2-001 1.  The  U.  S.  Government  is  authorized  to  reproduce  and  distribute 
reprints  for  Government  purposes  notwithstanding  any  copyright  notation  thereon.  The  views  and  conclusions 
contained  in  this  document  are  those  of  the  authors  and  should  not  be  interpreted  as  representing  the  official 
policies,  either  expressed  or  implied,  of  the  Army  Research  Laboratory  or  the  U.  S.  Government. 
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1  Introduction 


Many  resource  sharing  systems  act  as  disordering  mechanisms  in  that  their  customers  (e.g., 
packets  in  a  communication  network  or  tasks  in  a  computer  system)  complete  service  in 
an  order  different  from  the  order  in  which  they  entered  the  system.  In  some  situations,  a 
resequencing  constraint  is  enforced  by  putting  out-of-order  customers  into  a  resequencing 
buffer  (after  service  completion)  and  delaying  them  until  earlier  customers  catch  up  with 
them.  The  impact  of  such  resequencing  mechanisms  on  overall  system  performance  is  not 
always  well  understood.  This  can  be  attributed  in  paid  to  the  fact  that  even  in  the  simplest 
of  cases,  the  corresponding  queueing  models  arc  not  analytically  tractable. 

Earlier  work  on  queueing  systems  with  resequencing  constraints  is  reported  in  [2,  5, 
7,  8,  18].  Here  we  focus  on  a  particular  “disordering  network”  composed  of  K  identical 
servers  operating  in  parallel,  each  attending  to  its  own  infinite  capacity  buffer  and  serving 
customers  in  FCFS  order.  Upon  arrival  to  the  system,  customers  arc  routed  to  one  of  the 
servers,  with  routing  decisions  being  independent  of  the  state  of  the  system.  Prominent 
among  such  routing  mechanisms  is  the  Round-Robin  customer  assignment.  After  service 
completion,  each  customer  is  required  to  leave  the  system  in  the  order  in  which  it  arrived, 
thereby  possibly  experiencing  an  additional  delay  in  the  resequencing  buffer.  Of  particular 
interest  is  the  end-to-end  delay  experienced  by  customers;  this  quantity  is  defined  as  the  sum 
of  the  time  spent  waiting  in  buffer  for  service  (i.e.,  the  waiting  time),  the  time  in  service 
and  the  time  spent  in  the  resequencing  buffer  (i.e.,  the  resequencing  delay). 

We  assume  customer  arrivals  to  be  modelled  by  a  renewal  process,  and  the  service 
times  to  be  i.i.d.  and  independent  of  the  arrival  process.  We  arc  interested  not  in  evalu¬ 
ating  various  statistics  of  the  customer  end-to-end  delay  under  these  routing  assignments, 
but  in  identifying  the  routing  mechanism  minimizing  this  quantity  in  some  suitable  sense. 
Intuitively,  owing  to  its  deterministic  nature,  the  Round-Robin  customer  assignment  should 
yield  a  smaller  end-to-end  delay  than  any  other  policy  operating  without  state  information, 
as  yet  another  instance  of  the  folk  theorem  that  “determinism  minimizes  delays”  [2]  (and 
references  therein).  For  instance,  by  the  extremal  property  in  [16,  Prop.  6.3.1,  p.  114], 
the  steady  state  waiting  time  under  Round-Robin  is  known  to  be  smaller  in  the  increas¬ 
ing  convex  ordering  than  that  under  the  Bernoulli  customer  assignment.  Thus,  in  line  with 
this  result,  we  would  expect  similar  stochastic  comparisons  to  hold  in  steady  state  for  the 
end-to-end  delay  in  the  system  of  parallel  queues  with  resequencing. 

This  paper  is  concerned  with  validating  the  optimality  of  the  Round  -  Robin  routing 
mechanism.  For  reasons  to  be  explained  shortly,  we  investigate  the  desired  stochastic  com¬ 
parisons  in  two  asymptotic  regimes,  namely,  heavy  and  light  loads.  In  particular,  the  heavy 
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traffic  limit  for  the  end-to-end  delay  under  Round-Robin  assignment  is  shown  to  be  smaller, 
in  the  increasing  convex  stochastic  ordering,  than  its  counterpart  under  any  other  routing 
policy  admitting  a  certain  Functional  Central  Limit  Theorem  (in  the  form  of  Assumption 
(D)  of  Section  7).  In  light  traffic,  with  Poisson  arrivals,  we  show  that  Round-Robin  rout¬ 
ing  achieves  the  smallest  (in  the  strong  stochastic  ordering)  end-to-end  delay  amongst  all 
routing  policies  operating  without  queue  state  information  (as  understood  in  Assumption 
(A)  of  Section  3).  These  asymptotic  comparisons  are  certainly  compatible  with  the  desired 
optimality  across  all  traffic  intensities,  and  give  a  strong  indication  of  its  validity;  this  is 
further  reinforced  by  the  limited  simulation  experiments  reported  in  Section  12  for  Poisson 
arrivals. 

The  difficulty  in  providing  the  desired  comparison  across  the  entire  traffic  range  for 
stability  lies  in  the  fact  that  the  end-to-end  delay  is  a  function  of  the  entire  workload  vec¬ 
tor.  Under  the  enforced  assumptions,  the  behavior  of  each  queue  in  isolation  is  that  of  a 
GI\GI\  1  queue  under  each  of  the  routing  mechanisms.  This  fact  was  exploited  in  the  proof 
of  Proposition  6.3.1  [16,  p.  114]  to  compare  the  customer  waiting  times  in  the  increasing 
convex  stochastic  ordering.  However,  in  general  the  K  parallel  single  server  queues  are  not 
independent,  thereby  precluding  the  derivation  of  closed-form  expressions  for  the  distribu¬ 
tions  of  interest,  even  when  such  expressions  are  available  for  the  corresponding  G7|G7|  1 
queue. 

This  paper  is  organized  as  follows:  The  system  model  and  basic  performance  metrics 
are  presented  in  Section  2.  Section  3  contains  the  basic  statistical  assumptions,  and  the 
existence  of  a  steady  state  (or  stationary)  regime  is  discussed  in  Section  4.  The  heavy  traffic 
problem  is  introduced  in  Section  5.  This  is  followed  in  Section  6  by  a  summary  of  the 
heavy  traffic  methodology  via  weak  convergence  in  function  spaces.  The  assumptions  for 
establishing  the  relevant  heavy  traffic  limits  are  presented  in  Section  7,  and  the  heavy  traffic 
results  are  then  developed  in  Section  8.  These  results  are  used  to  obtain  stochastic  compar¬ 
isons  in  heavy  traffic  in  Section  9.  As  a  preamble  to  the  light  traffic  results,  we  summarize 
the  Reiman-Simon  theory  in  Section  10.  The  light  traffic  calculations  and  subsequent  com¬ 
parisons  are  then  discussed  in  Section  11.  Finally,  Section  12  discusses  numerical  examples 
that  illustrate  the  results.  A  number  of  proofs  are  given  in  Appendix  A. 

A  few  words  on  the  notation  in  use  here:  Throughout,  let  K  denote  a  given  positive 
integer.  Vectors  are  denoted  in  boldface  and  are  always  interpreted  as  row  vectors.  More¬ 
over,  the  kth  component  of  any  element  x  in  1RA  is  denoted  by  xk,  k  =  1, . . . ,  K,  so 
that  x  =  (a;1, . . . ,  xK ).  A  similar  convention  is  used  for  random  variables  (rvs).  For  any 
scalar  x  in  1R,  we  denote  by  modx(x)  the  mod/c -equivalent  of  x  in  the  interval  [0.  K). 
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We  use  =>r  to  denote  weak  convergence  (with  r  going  to  infinity),  and  refer  the  reader  to 
the  monographs  [3,21]  for  additional  information  on  weak  convergence.  We  use  <st,  <cx 
and  <icx  to  denote  inequality  in  the  strong,  convex  and  increasing  convex  stochastic  order¬ 
ings,  respectively.  Additional  material  on  these  orderings  can  be  found  in  the  monographs 
[14,  15,  16].  Equality  in  distribution  between  two  rvs  is  denoted  simply  by  =^t. 

2  The  system  dynamics 

To  introduce  the  system  of  K{>  2)  parallel  queues  with  resequencing,  we  start  with  the 
sequences  of  IRf -valued  rvs  {rn+ 1,  n  =  0, 1, . . .}  and  {an,  n  =  0, 1, . . .},  and  with 
the  sequence  of  {1, . . . ,  A'}-valued  rvs  {vn,  n  =  0, 1, . . .}.  With  this  last  sequence  we 
associate  a  new  sequence  of  {0, 1}A -valued  rvs  {un,  n  =  0, 1, . . .}  by  setting 

uk=8(vn,k),  k  =  l,...,K;  n  =  0,1,....  (1) 

Throughout  these  quantities  are  given  the  following  interpretation:  For  each  n  =  0, 1, . . ., 
the  interarrival  time  between  the  nth  and  the  (n+  l)r's/  customers  is  denoted  by  t,l+\  (with 
the  convention  that  the  0th  customer  arrives  at  time  t  =  0).  The  nlh  customer  brings  an 
amount  of  work  that  requires  an  units  of  execution  time,  while  un  =  h  (or,  equivalently, 
ii'n  =  1)  indicates  that  the  nth  customer  is  routed  to  the  kth  queue. 

We  now  define  the  performance  measure  of  interest  under  the  assumption  that  the  sys¬ 
tem  is  empty  at  time  t  =  0.  For  each  k  =  1, . . . ,  K,  let  represent  the  work  remaining  in 
the  kth  queue  as  seen  by  the  nth  customer  just  before  entering  the  system.  The  IR,  -valued 
rvs  {iVn,  n  =  0, 1, . . .}  evolve  according  to  the  Findley  recursion 

Wn+l  =  [wn  +  ~  ^n+l)  ,  U  =  0,  1,  ...  .  (2) 

with  Wq  =  0.  Note  that  Wkn  would  be  the  waiting  time  of  the  nth  customer,  were  she  in 
fact  to  join  the  kth  queue.  Consequently,  the  time  dn  that  the  nth  customer  spends  either  in 
buffer  waiting  for  service  or  in  service  is  defined  by 

K  /  K  \ 

dn  :=  ^2  ukn  (wk  +  CTn)  =  I  22  unwn  )  +  °n,  n  =  0,  1,  ...  .  (3) 

k= 1  \fe=l  / 

As  a  global  resequencing  constraint  is  imposed  on  successive  customers,  a  customer 
may  spend  time  in  a  resequencing  buffer  after  service  completion,  in  order  to  wait  for 
earlier  customers  which  have  been  delayed.  With  this  in  mind  we  introduce  the  end-to-end 
delay  of  the  nth  customer  as  the  rv  vn,  which  accounts  for  the  time  spent  waiting  in  buffer 
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for  service,  the  time  in  service  and  the  time  spent  in  the  resequencing  buffer.  It  is  easy  to 
see  that 

vn  =  max  (w*  +  u^an)  ,  n  =  0, 1, -  (4) 

k=l \  / 

3  Statistical  assumptions 

In  this  paper,  we  consider  routing  policies  that  balance  the  load  among  the  K  queues  by  tak¬ 
ing  routing  decisions  which  arc  independent  of  both  the  arrival  process  and  the  sequence  of 
service  times,  but  which  arc  possibly  dependent  on  past  routing  decisions.  This  is  captured 
through  the  following  set  of  assumptions: 

Assumption  (A)  (i)  The  three  sequences  {rn+i,  n  =  0,1,...},  { crn ,  n  =  0,1,...} 
and  {on,  n  =  0, 1, . . .}  are  mutually  independent;  (ii)  The  IIv ,  -valued  rvs  {t„+i,  n  = 
0, 1, . . .}  form  an  i.i.d.  sequence  with  finite  variance  var  [t];  (iii)  The  ET  -valued  tys 
{an,  n  =  0, 1, . .  form  an  i.i.d.  sequence  with  distribution  G  and  finite  variance  var  [a]; 
(iv)  The  {1, . . . ,  K}-valued  tys  {on,  n  =  0, 1, . .  form  a  stationary  sequence  with 

P  [un  =  k\  =  k  =  l,...,K,  n  =  0,1,....  (5) 

Under  (A),  let  a  and  r  denote  a  pair  of  independent  rvs;  these  are  generic  representatives 
of  the  i.i.d.  sequences  { an ,  n  =  0, 1, . . .}  and  {rn+ 1,  n  =  0, 1, . . .},  respectively.  Paid 
(iv)  of  Assumption  (A)  guarantees  that  the  {0, 1}A -valued  rvs  {un,  n  =  0, 1, . . .}  given 
by  (1)  also  form  a  stationary  sequence.  Any  routing  policy  {i^,  n  =  0, 1, . . .}  satisfying 
Assumption  (A)  is  said  to  be  admissible. 

Of  central  interest  is  the  Round-Robin  customer  assignment.  This  is  implemented 
through  the  routing  rvs  ,  n  =  0, 1, . . .}  given  by 

z/A  =  mod K{y*  +  n  —  1)  +  1,  n  =  0, 1, . . .  (6) 

with  rv  v*  uniform  over  {1, . . .  ,  K},  i.e., 

P  [z/  =  &]  =  -L,  k  =  1, . . . ,  K.  (7) 

With  this  definition,  the  0th  customer  is  randomly  routed  to  one  of  the  K  queues.  We  also 
specialize  several  results  to  the  Bernoulli  customer  assignment,  which  is  characterized  by 
the  routing  rvs  {izf ,  n  =  0, 1, . . .}  being  i.i.d.  rvs  with  common  distribution  given  by 

pb?  =  /y \  =  Jf'  k=l,...,K,  n  =  0,1,...  (8) 
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Under  either  assignment,  the  routing  rvs  { un ,  n  =  0, 1, . . .}  form  a  stationary  sequence 
of  {1, . . .  .  A'} -valued  rvs  with  common  marginal  distribution  given  by  (5),  hence  both 
Round-Robin  and  Bernoulli  are  admissible  routing  policies.  Following  the  usage  started 
in  (8)  and  (6),  quantities  associated  with  the  system  under  the  Bernoulli  and  Round-Robin 
customer  assignments  are  distinguished  by  the  superscript  B  and  R,  respectively.  Omission 
of  the  superscript  will  reflect  the  fact  that  the  discussion  holds  for  any  admissible  policy. 


4  Steady  state  regimes  and  stochastic  comparisons 


Under  any  admissible  routing  policy,  the  system  is  stable  if  and  only  if  each  of  the  K 
queues  is  stable.  It  is  a  simple  matter  to  check  that  this  will  happen  if  and  only  the  (server) 
utilization  p  is  less  than  one,  namely 


EH 


K E  [r] 


<  1. 


(9) 


The  precise  formulation  of  this  stability  property  is  contained  in  a  multi-dimensional  analog 
of  Loynes’  result  [10]  given  below;  its  proof  is  straightforward  and  omitted  for  the  sake  of 
brevity. 

In  order  to  state  the  result  we  need  to  expand  the  setup  of  Assumption  (A)  to  bi-infinite 
sequences,  possibly  by  enlarging  the  underlying  probability  space  in  the  usual  manner. 
Thus,  whenever  Assumption  (A)  holds,  we  arc  to  understand  the  following:  (i)  There 
exist  three  bi-infinite  sequences  {r^+i,  n  =  0,  ±1,  ±2, . . {on,  n  =  0,  ±1,  ±2, . . .} 
and  {un,  n  =  0,  ±1,  ±2, . . .}  which  arc  mutually  independent;  (ii)  The  111:  -valued  rvs 
{rn_ |_i,  n  =  0,  ±1,  ±2, . . .}  form  an  i.i.d.  sequence  with  finite  variance  var  [r];  (iii)  The 
]R+-valued  rvs  {an,  n  =  0,  ±1,  ±2, . . .}  form  an  i.i.d.  sequence  with  distribution  G  and 
finite  variance  var  [cr] ;  (iv)  The  {1, . . . ,  iT}-valued  rvs  {i/n,  n  =  0,  ±1,  ±2, . . .}  form  a 
stationary  sequence  with 


P  [vn  =  A;] 


1 

K' 


k  =  l,...,K,  n  =  0,±1,±2,...  . 


(10) 


Fix  k  =  1,2, ,  K.  We  define  the  sequence  of  partial  sums  {s*j  ,  n  =  0,  ±1,  ±2, . . .} 


by 


n 

£&  if  n  =  1,2, . . . 
m=  1 


0 

£  Cm  if  n  =  -l,-2,... 

«.  m=n-\-l 


(ii) 
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where  for  each  n  =  0,  ±1,  ±2, . . we  have  set 


■S+l  ~ 


k 

7"n+ 1 


with 


ukn  =  8(vn,  k ). 


(12) 

(13) 


Proposition  4.1  Under  Assumption  (A),  the  stability  condition  (9)  ensures  that  Wn  ==>n 
Woo  =  {wlo,  ...,w%o)  and  vn  =>n  Voo  with 

Wo o  :=  sup  (s^,  m  =  0,  -1, . . ,  k=l,...,K  (14) 

and 

Voo  ■=  max  (wkoo  +  Uqcjq )  .  (15) 

k=l,...,K  \  / 

We  refer  to  Woo  and  Voo  as  the  stationary  workload  vector  and  end-to-end  delay,  re¬ 
spectively.  To  shed  light  into  their  representations  (14)  and  (15),  we  note  the  monotone 
convergence 

Wo o  =  lim  wk,  k  =  1, . . . ,  K  (16) 

n—>  oo 

where  we  have  set 

wk  :=  max  m  =  0,  —  1, . . . ,  —  nj  ,  n=  1,2,...  (17) 

For  each  a  =  1,2,...,  stationarity  implies  that 

wk  =st  wk  and  vn  =st  vn  (18) 


with 

vn  :=  max  (wk  +  UqOq  )  .  (19) 

k=l,...,K  \  / 

This  identification  reflects  the  usual  Loynes’s  "backward  in  time”  arguments  to  construct 
the  stationary  regime  [10]. 

Under  the  enforced  assumptions,  it  holds  that  =st  . . .  =st  w^,  and  we  readily 
conclude  from  (3)  and  (14)  that 

dn  =Ui,  doc  with  *»:=  (E«)+^o.  (20) 

It  is  well  known  [16,  Prop.  6.3.1,  p.  114]  that  wj^R  <icx  ,  so  that  <icx  d ^ 
in  view  of  (20).  It  is  therefore  natural  to  wonder  whether  such  a  comparison  also  holds 
between  the  end-to-end  delays  and  v^,  namely  <lcx  v^.  It  turns  out  that  an 
answer  to  this  question  is  much  more  elusive,  and  prompts  us  instead  to  seek  such  stochastic 
comparisons  in  the  limiting  regimes  of  heavy  and  light  traffic. 
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5  The  heavy  traffic  problem 


We  seek  a  characterization  of  the  system  of  parallel  queues  with  resequencing  in  the  case 
where  it  is  almost  fully  utilized,  i.e.,  the  utilization,  though  less  than  one,  is  very  close 
to  unity.  This  heavy  traffic  characterization  entails  model  simplifications  which  allow  for 
subsequent  comparison  between  of  the  end-to-end  delays  under  Round-Robin  and  any  other 
admissible  routing  policy. 

To  do  so,  we  embed  the  system  of  parallel  queues  into  a  parametric  family  of  like 
queueing  systems,  indexed  by  an  integer  (say  r),  with  the  property  that  the  utilization  p 
of  the  rth  system  tends  to  the  critical  value  1  as  r  goes  to  infinity.  These  systems  dif¬ 
fer  only  through  their  arrival  sequences.  Specifically,  for  each  r  =  1,2, . . .,  the  7th  sys¬ 
tem  of  parallel  queues  with  resequencing  is  one  driven  by  the  sequence  of  service  times 
{an,  n  =  0,  ±1,  ±2, . . .},  the  sequence  of  routing  rvs  {un,  n  =  0,  ±1,  ±2, . . .}  and  the 
arrival  sequence  {r^+1,  n  =  0,  ±1,  ±2, . . .}  under  Assumption  (A).  Quantities  associated 
with  the  rth  system  arc  superscripted  by  r. 

We  take  pr  <  1,  or  equivalently,  E  M  <  K E  [rr] ,  to  ensure  stability  of  the  rth  system, 
so  that  wrn  =$-n  nlQ  and  vn  =X  by  Proposition  4.1.  However,  we  drive  the  family 
of  systems  to  heavy  traffic  by  assuming  that 

lim  E  [rr]  =  ^  E  [a] .  (21) 

Clearly,  as  r  goes  to  infinity,  the  components  of  the  stationary  workload  vector  wQ  grow 
unbounded.  It  is  therefore  appropriate  to  seek  a  scaling  sequence  { or ,  r  =  1,2,...}  with 
Hindoo ar  =  oo  such  that  the  convergence  in  distribution 

ar^1wr00  =X  mHT  (22) 

takes  place  to  some  IR^  -valued  rv  iuht  =  ?  •  •  • ,  ^ht)-  b  then  follows  from  (15)  that 

ar~1vl0  =>r  ^HT  (23) 

with  1R+  -valued  rv  vrt  determined  through  the  relation 

vht  =  nrax  mfjT.  (24) 

k=l,...,K 

It  is  customary  to  refer  to  iuht  and  cht  as  the  heavy  traffic  limits. 


6  The  heavy  traffic  methodology 


In  order  to  identify  the  scaling  sequence  and  the  heavy  traffic  limits  in  (22)-(24),  we  take  the 
indirect  approach  based  on  diffusion  limits  whereby  the  quantities  of  interest  arc  rescaled 
both  in  the  time  and  state  space  variables  [1,  19]. 

To  introduce  the  basic  ideas,  fix  r  =  1, 2, . . .  and  k  =  1, . . . ,  K.  The  identification  (18) 
leads  in  the  usual  manner  [19,  21]  to  considering  the  rvs 


W[rt]  =  max  (smfc ,  m  =  0,-1,...,-  [rt\ ) 
=  max  0  <u<tj,  t  >  0 


v[rt]  =  k  ™axA-  ( w\n |  +  uoao )  »  (26) 

Next,  we  define  the  H-valued  processes  {>S r,k(t),  t  >  0}  and  {Wr’k(t),  t.  >  0}  by 

~r,k 

1  U) 

V?(*-M'E[5-m])  an[l  t>  0.  (27) 

The  1RA -valued  processes  with  components  given  by  (27)  are  denoted  by  {Sk (t)  ,t>  0} 
and  {W  (t),  t  >  0},  respectively. 

With  the  help  of  (25)  we  note  that 

Wr’k(t)=  sup  (Sr’k{u)  -Y’k{u))  ,  t  >  0  (28) 

where  we  have  defined  the  function  'f'k  :  IR  ,  D!  by 

:=  -4  E  [/2frtI]  ,  t  >  0.  (29) 


Finally,  we  define  the  IR-valued  process  {V  it).  t  >  0}  by 

Vr{t)  :=  ^  rnax^  ^Wr,k(t)  +  Uq^j=  \  ,  t>  0.  (30) 

The  next  step  consists  in  letting  r  go  to  infinity  in  these  definitions,  with  limits  un¬ 
derstood  in  the  sense  of  weak  convergence  on  function  spaces  [3]:  For  each  T  >  0,  let 
D[0,  T]k  denote  the  space  of  mappings  [0,  T]  — >  1RA  which  arc  right  continuous  with  left 
limits;  as  usual  the  vector  space  D[ 0,  T]A  is  equipped  with  the  Skorokhod  topology.  Con¬ 
sider  the  sequence  of  ]RA-valued  processes  {Xr(t),  t  >  0}  (r  =  1, 2, . . .)  with  sample 
paths  in  D[ 0,  oo)A .  Whenever,  for  each  T  >  0,  the  weak  convergence 

{Xr(t),  0  <t<  T}^r{X(t),  0<t<T}  in  79[0,  T]K 
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takes  place  (under  the  Skorokhod  topology)  for  some  1RA -valued  process  {X(t)  ,t>  0} 
with  sample  paths  in  D[ 0,  oo]^ ,  we  simply  write 

{Xr(t),  t.  >  0}  =>r  {X(t),  t  >  0}. 

It  is  plain  from  (28)  and  (30)  that  the  processes  \W  (t),  t  >  0}  and  {Vr(t),  t  >  0}  are 
obtained  through  non-linear  functionals  on  the  process  { S  (t)  ,  t  >  0}.  This  observation 
suggests  that  the  limit  properties  of  the  latter  process  will  determine  those  of  the  former 
group.  To  emphasize  this  point  further,  for  each  T  >  0  we  introduce  the  supremum  mapping 
Mt  :  D{ 0,  T]  — >  D[ 0,  T]  defined  by 

Mr{x)(t)  :=  sup  x(u),  0  <  t  <  T  (31) 

0<u<t 

at  element  x  of  D[0,  T],  In  particular,  relation  (28)  now  becomes 

Wr'k{t)  =  MT({Sr’k(u)  -  Y’k{u),  0  <u<  T})(t),  0  <  t  <  T.  (32) 

It  is  well  known  that  the  supremum  mapping  Mr  :  D[0,  T ]  — ►  L>[0,  T ]  is  continuous  under 
the  Skorokhod  topology  [20,  Thm  6.4,  p.  81], 

7  The  heavy  traffic  assumptions 

A  number  of  additional  assumptions  are  needed  to  carry  out  the  discussion.  Assumption 
(B)  below  complements  (21);  it  is  enforced  thereafter  and  ensures  that  the  system  described 
by  (28)-(30)  is  driven  to  heavy  traffic  at  the  appropriate  speed. 

Assumption  (B)  The  sequence  of  generic  interarrival  times  {f,  r  =  1,2,...}  satisfies 

lim  y/r  ( \  E  [<r]  -  E  [rrA  =  -7 

r—>  00  yA  J 

for  some  7  >  0. 

Under  Assumption  (A),  for  each  k  =  1, . . . ,  K,  we  have 

[rt]-l 

E  =  EH£e  [uk]  -  [rt]E  [rr] ,  t  >  0. 

n= 0 

Hence,  Assumption  (B)  readily  leads  via  (29)  to 

lim  7 r,k(t)  =  jti  t  ^  0  (33) 

r^>  00 

under  any  admissible  routing  policy. 

We  follow  up  with  a  technical  assumption  on  the  arrival  sequence: 
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Assumption  (C)  The  rvs  { | rr | 2 .  r  =  1,2,...}  are  uniformly  integrable  rvs  with  £2  := 

lim  var  [tH  >  0. 
r— >oo 


Assumption  (C)  ensures  the  validity  of  a  version  of  Donsker’s  Theorem  [3,  Thm.  16.1, 
p.  137]  in  the  form  of  the  following  Functional  Central  Limit  Theorem  (FCLT),  namely 

f  1  M_1  1 

|  E  «+i  -  E^r])»  t  >  0  \  =^r  {C B(t),t  >  0}.  (34) 

with  {77(f),  t  >  0}  a  standard  one-dimensional  Brownian  motion.  The  uniform  integra- 
bility  in  Assumption  (C)  is  used  to  validate  the  appropriate  Lindeberg’s  condition  [3,  Eqn. 
(7.3).  p.  42], 

The  heavy  traffic  results  will  be  established  only  for  those  admissible  routing  policies 
which  admit  a  FCLT  in  a  sense  which  we  now  describe:  Here,  and  throughout,  let  1  denote 
the  element  (1,...,1)  in  1RA.  Next,  consider  an  admissible  routing  policy  { vn ,  n  = 
0, 1, . . .}  with  corresponding  sequence  {un,  n  =  0, 1, . . .}.  For  each  r  =  1, 2, . . .,  we 
define  the  IRA -valued  process  t  >  0}  by 


U'\t) 


t  >  0. 


(35) 


Assumption  (D)  Consider  an  admissible  routing  policy  { un ,  n  =  0, 1, . . .}.  The  corre¬ 
sponding  sequence  {tin,  n  =  0, 1, . . .}  satisfies  the  FCLT  in  the  form 


{ Ur{t ),  t  >  0}  =^r  {T1/2A(f),  t  >  0} 


(36) 


where  (A(f)  ,  f  >  0}  is  a  K-dimensional  standard  Brownian  motion,  and  T  is  the  K  x  K 
covariance  matrix  determined  by 


Tup  =  lim  — cov 


r— >oo  t 


r—  1 


r—1 


''f  ^  vin(jn,  y  ^  umam 


Ln=0 


m.= 0 


k,e  =  1 


(37) 


An  admissible  routing  policy  is  said  to  be  HT-admissible  if  Assumption  (D)  holds.  The 
role  of  the  matrix  F  in  (36)  can  be  made  more  transparent  as  follows:  For  each  t  >  0,  (37) 
is  equivalent  to 

~  rt  ■  ereT,  e  e  trk  (38) 


var 


M-i 

E 

n= 0 
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for  r  becoming  large.  Therefore,  with  the  Cramer- Wold  device  [3,  p.  48]  in  mind,  we  now 
see  that  (36)  implies  the  convergence 


where  U  denotes  the  standard  zero-mean  unit  variance  Gaussian  rv.  This  last  convergence 
is  in  the  form  of  a  Central  Limit  Theorem  for  identically  distributed  rvs  which  arc  not 
necessarily  independent;  this  is  an  extensively  studied  problem  for  which  results  abound  in 
the  literature.  As  HT-admissibility  represents  the  functional  form  of  such  CLT  results,  it  is 
expected  to  be  satisfied  by  a  large  class  of  admissible  routing  policies.  The  reader  is  refered 
to  Section  4.4  of  the  monograph  by  Whitt  [21]  for  an  overview  of  some  of  the  possibilities. 

The  next  result  determines  the  impact  of  the  routing  policy  on  the  covariance  matrix  T. 
Its  proof  is  available  in  Appendix  A.  1. 


Lemma  7.1  The  K  x  K  covariance  matrix  T  given  by  (37)  exists  if  and  only  if  the  K  x  K 
covariance  matrix  T  determined  by 


r— 1  r— 1 


Th  =  lim  -cov  V  u*,  y Zum  >  k,£=l,...,K 

r — r  < 


,n=0  771=0 


exists,  in  which  case 


rM  =  rH-E  [a}2  +  5(k,£) 


var  [cr] 


k,£=  1 


8  The  heavy  traffic  limits 

We  begin  by  discussing  the  HT-admissibility  of  Round-Robin  and  Bernoulli  routing.  Proofs 
arc  available  in  Appendix  A.2. 

Proposition  8.1  Both  Bernoulli  and  Round-Robin  routing  policies  satisfy  Assumption  (D) 
with  covariance  matrices  (40)  given  by 

f &  =  8(k,e)±  (i  -  1)  ,  k,£=  (42) 

and 

=  0,  k,£=l,...,K,  (43) 

respectively. 
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We  arc  now  ready  to  develop  the  requisite  heavy  traffic  limits  under  an  arbitrary  HT- 
admissible  routing  policy. 

Proposition  8.2  Consider  an  HT-admissible  routing  policy  { un ,  n  =  0, 1, . . .}  under  the 
Assumptions  (A)-(D).  The  convergence 

{, Sr(t ),  t  >  0}  =>r  {S(t),  t  >  0}  (44) 

holds  with 

S{t)  :=  B{t)E1/2,  t  >  0  (45) 

where  {B(t)  ,t>  0}  denotes  a  K— dimensional  standard  Brownian  motion  and  the  K  x  K 

covariance  matrix  S  is  given  by 

'Bu  =  Tfcr  +  C2)  k,£=l,...,K.  (46) 

With  the  help  of  (41),  we  can  rewrite  (46)  more  compactly  in  matrix  form  as 

S  =  T  +  C2E  =  f  •  E  [a]2  +  I  +  C 2E  (47) 

K 

rp  TS 

where  E  is  the  K  x  K  covariance  matrix  1  1,  and  /  denotes  the  identity  matrix  on  1R  . 


Proof.  Under  Assumption  (C),  (34)  can  be  given  a  multi-dimensional  version  in  the  form 


[rt]~  1 

\  ^ 


n 

v  n=() 


^  K+i  -e^D1.  t  >  o 


{(B{t)l,t>0}. 


(48) 


Given  the  enforced  independence  assumptions,  the  Brownian  motions  {B(t)  ,t>  0}  above 
and  { A(f),  t  >  0}  of  (36)  can  be  taken  to  be  mutually  independent.  Hence,  for  each  t  >  0, 
we  have1 


cov 


A^T1'2  +  (B(t)l 


since  var  [H(f)]  =  t  and  cov  [A(f)] 

and  the  identification 


=  cov  +(2cov[B(t)l] 

=  r1/2cov  [A(t)\  T1/2  +  C2lTvar  [B(t)}  1 

=  (r  +  C2lTl)  t  (49) 

=  I  ■  t.  In  short,  cov  lAiDT1/2  +  (B{t)l\  =  S  -t. 


{A^T1'2  +  (B(t)  1,  t  >  0}  =st  {B{t)T}/2,  t  >  0}  (50) 

'Recall  that  T  and  T1^2  are  symmetric  matrices. 
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follows  by  the  usual  characterization  of  Brownian  motion. 

To  conclude,  recall  the  definition  (27)  and  (35)  (together  with  (11)  and  (12)).  Making 
use  of  (36),  (33)  and  (48),  we  find  that 

1  i  M  1  1 

<  Ur(t)  +  -J=  £  «+1  -  E  [rr])l,  t  >  0  \  {B(t)£1/2,  t  >  0}. 


This  an  easy  consequence  of  the  Continuous  Mapping  Theorem  [3,  p.  29]  [19,  p.  320] 
when  coupled  with  Theorem  3.2  in  [3,  p.  21].  This  completes  the  proof  of  (44)  as  we  note 
the  stochastic  equivalencce 

«+l-E[C])l,  (>o| 


{«'(*),  t  >  0}  =„  l  U'\t)  + 


,  [rt]~ 

—  T 

y/r  ^ 

v  n= 0 


which  is  easily  validated  under  the  enforced  assumptions  (A). 


Whenever  convergence  (44)  holds,  we  conclude  that 

{w  \t),  t  >  0}  =^r  {W(t),  t  >  0}  (51) 

with 

Wk(t)  :=  sup  (sk(u)  —  7 ii  \  ,  k  =  1, . . . ,  K,  t  >  0.  (52) 

o <u<t  '  ' 

This  convergence  is  a  direct  consequence  of  the  Continuous  Mapping  Theorem  [3,  p.  29] 
[19,  p.  320]  (via  (32)  and  (33))  given  the  aforementioned  continuity  of  the  supremum 
mapping  (31)  in  the  Skorokhod  topology;  details  for  the  multi-dimensional  extension  arc 
standard  and  left  to  the  interested  reader. 

Now,  going  back  to  (30)  we  see  that 

0  <  Vr{t)  -  max  Wr’k{t)  <  -^L,  t>  0  (53) 

~  k=i,...,K  s/r 

for  each  r  =  1,2,....  Applying  the  Continuous  Mapping  Theorem  [3,  p.  29],  in  conjunc¬ 
tion  with  (51),  yields  {  max  Wr,k(t ),  t  >  0}  =>r  {V(t),  t  >  0}  where 

k=l,...,K 

V(t)  :=  max  Wk{t),  t  >  0.  (54) 

k=l,...,K 

The  conclusion 

{Vr(t),  t  >  0}  ^.r  {V(t),  t  >  0} 
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is  now  a  straightforward  consequence  of  the  inequality  (53)  and  of  the  Convergence  To¬ 
gether  Theorem  [3,  Thm.  4.1,  p.  25]. 

Let  t  go  to  infinity  in  (52)  and  (54).  Standard  monotonicity  arguments  yield  the  station¬ 
ary  heavy  traffic  workload  vector  W  and  end-to-end  delay  V  as  the  limiting  rvs  lim  W (t)  = 

t — >oo 

W  and  lim  V(t)  =  V  with 

t — >oo 

Wk  :=  sup  (sk{t)  -  yt)  ,  k=  1, . . . ,  K  (55) 

t>  o  k  ' 

and 

V  :=  max  Wk.  (56) 

k=l,...,K 

The  finiteness  of  these  rvs  is  discussed  in  the  course  of  proving  Proposition  9.3. 

Going  back  to  (22)-(24),  we  see  that  we  can  select  ar  =  \/7\  and  the  arguments  in  the 
one-dimensional  case  [1]  readily  extend  to  yield  the  identification 

W  =st  10HT  and  V  =st  vHt,  (57) 

thereby  validating  the  use  of  diffusion  limits  to  secure  heavy  traffic  results. 

9  Heavy  traffic  optimality  of  Round  -  Robin  routing 

We  arc  interested  in  a  stochastic  comparison  in  heavy  traffic  between  the  end-to-end  delay 
under  Round-Robin  and  that  of  any  other  HT-admissible  routing  policy.  Our  first  step  in 
this  direction  is  a  characterization  of  the  convex  ordering  for  Gaussian  rvs  due  to  Muller 
[11,  Thm.  3.3]. 

Proposition  9.1  Let  X  and  X1  denote  two  normally  distributed  Wx -valued  rvs,  say  X  =,/ 
A f(fJL,  £)  and  X'  =st  A £/),  respectively.  Then  X  <cx  X'  if  and  only  if  p  =  p!  and 
the  d  x  d  matrix  X  —  L  is  positive  semi-definite. 

Consider  now  an  HT-admissible  routing  policy  { un ,  n  =  0, 1, . . .}  under  the  Assump¬ 
tions  (A)-(D).  To  apply  Proposition  9.1  we  fix  some  n  =  1,2, . . .,  and  with  any  ordered 
n-tuple  t\  <  . . .  <  tn  in  1R+,  we  associate  the  nK -dimensional  rv  S(t\, . . . ,  tn)  given  by 

S(t :=(S( 

where  {S(t),  t  >  0}  is  the  1RA -valued  limiting  process  (45)  identified  in  Proposition  8.2. 
The  comparison  result  that  follows  is  established  in  Appendix  A.3.  As  usual,  the  superscript 
R  indicates  that  the  corresponding  quantity  is  evaluated  under  the  Round-Robin  policy. 
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Proposition  9.2  Consider  an  HT-admissible  routing  policy  under  the  Assumptions  (A)-(D ). 
For  all  n  =  1,2,...,  and  0  <  t\  <  ...  <  tn,  it  holds  that 

SR(ti,...,tn)  <cx  S(ti,...,tn).  (58) 


Comparison  (58)  leads  to  the  desired  stochastic  comparison  between  the  stationary 
heavy  traffic  end-to-end  delays  under  Round-Robin  and  any  other  HT-admissible  routing 
policy. 

Proposition  9.3  For  any  HT- admissible  routing  policy  under  Assumptions  (A)-(D),  it  holds 
that 

WR  <icxW  and  VR<icxV.  (59) 

In  particular,  making  use  of  the  identification  (57),  we  obtain  the  heavy  traffic  com¬ 
parison  /'jRp  <icx  i'ht,  which  suggests  the  validity  of  the  comparison  <icx  for 
sufficiently  large  r. 

Proof.  Fix  n  =  1,2, . . ..  In  the  notation  of  Proposition  9.2,  for  any  ordered  n-tuple 
0  <  t\  <  . . .  <  tn  (with  the  convention  to  =  0),  let  M(t\, . . . ,  tn)  denote  the  IRA -valued 
rv  with  components 

Mk(ti, ... ,  tn)  :=  max  ( Sk{U )  -  ytj,  i  =  0, 1, . . . ,  nj  ,  k=l,...,K. 

We  conclude  from  (58)  that 

MR(ti ,  .  .  •  ,  tn)  < icx  M(ti ,  .  .  .  ,  tn)  (60) 

owing  to  the  fact  that  comparisons  in  the  convex  increasing  ordering  arc  preserved  under 
increasing  convex  mappings  [15]. 

Before  we  can  make  use  of  these  comparisons,  we  need  some  preparatory  work:  Fix 
k  =  1. ....  K  and  note  from  the  definitions  (52)  and  (55)  that 

0  <  Wk{t)  <Wk,  t>  0.  (61) 

The  process  {Sk(t),  >  t  >  0}  is  statistically  indistinguishable  from  {(j}.Bk{t).  >  t  >  0} 
where  ri/.  =  y/z^k,  and  it  is  a  simple  matter  to  check  from  (47)  that  y.  >  0.  Thus,  by 
standard  results  on  the  supremum  of  Brownian  motion  [1,  3,  19],  the  r  vWk  is  exponentially 
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distributed,  and  the  rvs  {Wk(t),  t  >  0}  arc  therefore  uniformly  integrable  by  virtue  of  (61). 
The  uniform  integrability  of  the  1RA -valued  rvs  {Wit)-  t  >  0}  follows  with  lim  W  (t)  = 

t—>  OO 

w. 

Next,  fix  t  >  0.  For  each  p  =  1,2,...,  take  tpj  =  j2~pt  with  j  =  0, . . . ,  2P,  and  write 

Mk(t;p )  :=  Mk(tPi o,  tPt i, . . . ,  tPj2p)- 

In  this  notation,  comparison  (60)  yields 

MR(t;p)  <icx  M(t;p),  p=  1,2,....  (62) 

Note  that  M(t;p)  <  M(t\p  +  1)  <  W(t)  componentwise  for  all  p  =  0, 1, . . .  and  that 
for  each  k  =  1, . . . ,  K,  we  have  lim  Mk(t:  p)  =  Wk(t)  monotonically  from  below  by  a 

p — ►OO 

simple  continuity  argument.  Letting  p  go  to  infinity  in  (62)  yields 

wR\t) 

^ icx  W(t)  (63) 

by  the  uniform  integrability  of  the  rvs  {W(t),  t  >  0}  [16,  Prop.  1.3.2,  p.  10].  As  we  let 
t  go  to  infinity  in  (63),  we  get  the  first  convergence  in  (59)  [16,  Prop.  1.3.2,  p.  10]  upon 
invoking  again  the  aforementioned  uniform  integrability. 

The  second  convergence  is  now  immediate  from  the  fact  the  convex  increasing  mapping 
1Ra  — >  1R  :  x  — »  max  x'/c  preserves  comparisons  in  the  convex  increasing  ordering.  ■ 


10  Light  traffic  via  the  Reiman-Simon  theory 

We  now  shift  attention  to  the  light  traffic  regime.  This  refers  to  the  limiting  situation  where 
the  system  traffic  intensity  approaches  zero.  Throughout  this  section  we  assume  that  the 
customer  arrival  process  is  Poisson.  In  that  case  the  Reiman-Simon  theory  [12,  13]  applies, 
and  enables  us  to  calculate  derivatives  of  system  quantities  of  interest  with  respect  to  the 
intensity  of  the  Poisson  arrival  process,  when  this  intensity  tends  to  zero.  Here,  the  quantity 
of  interest  is  Pa  [t’oc  >  x]  (x  >  0),  the  complementary  cumulative  distribution  function  of 
the  stationary  end-to-end  delay.  Our  objective  is  to  compute  its  derivatives  of  order  zero 
and  one,  with  a  view  towards  establishing  asymptotic  optimality  of  Round-Robin  routing 
in  light  traffic.  To  that  end  we  next  highlight  the  key  points  of  the  Reiman-Simon  method, 
as  it  applies  in  our  context. 

As  in  Section  4,  we  start  by  introducing  bi-infinite  counterparts  to  the  sequences  of 
h  v  |  -valued  rvs  representing  customer  arrival  epochs  and  their  service  durations.  That 
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is,  we  consider  the  sample  space  (17,  T)  where  17  is  the  set  of  all  finite  and  infinite  se¬ 
quences  {(tn,an),  n  =  0,  ±1,±2, ...}  with  an  in  IR+  and  ...  <  7_i  <  0  =  to  < 
t\  <  ....  For  A  >  0,  we  introduce  a  probability  measure  PA  on  (17,  T7)  such  that  un¬ 
der  PA,  the  bi-infinite  sequence  of  interrarival  times  {rn,  n  =  0,  ±1,  ±2, . . .},  given  by 
rn  =  tn  —  tn- 1,  is  independent,  exponentially  distributed  with  parameter  A,  and  the  marks 
{an,  n  =  0,  ±1,  ±2, . . .}  are  i.i.d.  with  common  distribution  G  which  arc  independent  of 
{rn,  n  =  0,  ±1,  ±2, . . .}.  We  also  introduce  the  bi-infinite  sequences  of  routing  vectors 
{ un ,  n  =  0,  ±1,  ±2, . . .},  workload  vectors  {wn,  n  =  0,  ±1,  ±2, . . .},  and  end-to-end 
delays  { vn .  n  =  0,  ±1,  ±2, . . .}.  In  this  setup,  the  system  has  been  operating  from  time 
7  =  —  oo,  i.e.,  for  each  n  =  0,  ±1,  ±2, . . ., 


Wn+\  =  iwn  +  unan  ~  Tn+ 1]  +  ,  k=l,...,K 


(64) 


and 


vn  :=  max  (  wt  +  v!ian 
k=l,...,K  ' 


(65) 


Under  the  stability  condition  AE  [<r]  <  K,  convergence  to  the  stationary  rv  has  taken 
place  by  time  7  =  0,  i.e., 

vo  =st  Voc-  (66) 

Let  the  generic  system  performance  metric  0(A)  be  expressed  as 


0(A)  =  /  $  dPx 


(67) 


for  a  suitably  chosen  rv  $  :  17  — ►  1R.  For  example,  4>(u;)  can  be  chosen  as  the  system  time 
no  of  the  tagged  customer  arriving  at  time  7  =  0,  corresponding  to  a  sample  path  uj  in  17,  in 
which  case,  from  (66)  and  (67),  the  performance  metric  0(A)  is  the  expected  value  E\  [noo] 
of  the  stationary  end-to-end  delay  v^.  Application  of  the  Reiman-Simon  method  entails 
conditioning  on  the  number  of  arriving  customers  and  their  corresponding  service  times.  To 
do  so,  we  denote  by  0  the  event  where  no  customer  arrives  on  the  entire  real  line  (— oo,  oo), 
except  for  a  tagged  customer  who  arrives  at  time  7  =  0  with  service  time  oq.  For  each  7  in 
1R,  let  {7}  denote  the  event  where  in  addition  to  the  tagged  customer,  there  is  exactly  one 
more  arrival  occuring  at  time  7;  its  service  time  is  denoted  by  a. 

Next,  we  associate  with  $  several  auxiliary  functions,  namely  the  expected  values  of  <I\ 
conditionally  on  the  arrival  events  0  and  {7},  given  by 


$(0)  :=  Ea  [$  |  0]  and  $({7})  :=  EA  [<f>  |  {7}] ,  7  G  R .  (68) 


These  quantities  do  not  depend  on  A. 
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The  following  result  is  essentially  a  version  of  Theorem  2  given  in  [13,  p.  30].  It  pro¬ 
vides  formulas  for  the  derivatives  of  order  zero  and  one  of  f(\)  at  A  =  0+,  by  considering 
scenarios  where,  in  addition  to  the  tagged  customer,  at  most  one  more  customer  ever  joins 
the  system. 


Proposition  10.1  If  there  exists  9*  >  0  such  that  E 


<  oo  for  9  <  9*,  then 


and 


lim  <p(X )  =  <h(0) 

AJ.0 


(69) 


lx 0(o+)  :=  “JS  lx m  =  i  (®({f))  “  $(0)) dt 


(70) 


11  Light  traffic  optimality  of  Round-Robin  routing 

We  rely  on  Proposition  10.1  to  calculate  light  traffic  derivatives  of  the  distribution  of  the 
end-to-end  delay.  Using  these  derivatives  we  write  a  Taylor  expansion  of  the  end-to-end 
delay  distribution  around  A  =  0  given  in  the  next  proposition.  This  expansion  is  valid  for  all 
admissible  routing  policies  (prescribed  by  Assumption  (A)),  i.e.,  it  is  not  limited  to  Round- 
Robin  or  Bernoulli  routing.  It  depends  critically  on  the  event  that  the  routing  policy  assigns 
two  successive  customer  to  the  same  queue.  Throughout,  we  write  G(x)  :=  1  —  G(x) 

( x  >  0)  for  the  complementary  cumulative  service  time  distribution. 

Proposition  11.1  Assume  Poisson  arrivals  of  rate  A  and  finite  exponential  moments  for  the 
service  time  distribution  as  in  Proposition  10.1.  If  67(0)  =  0,  then  the  distribution  of  the 
end-to-end  delay  under  any  admissible  routing  policy  is  given  by 

Pa, Q  boo  >  x]  =  G(x)  +  a\  [a]  G(x)  -  J  G(x  -  y)G(y)  dy 

POO 

+(1  -  a)AG(x)  /  G(y)dy  +  o( A),  x  >  0,  (71) 

J  X 

where 

a  :=  P  b-i  =  I'o]  (72) 

denotes  the  probability  that  the  routing  policy  assigns  two  consecutive  arrivals  to  the  same 
queue. 

The  proof  of  Proposition  11.1  is  given  in  Appendix  A.4.  The  expansions  under  Round- 
Robin  and  Bernoulli  routing  can  be  obtained  as  easy  special  cases: 


19 


Corollary  11.1  In  the  setup  of  Proposition  11.1,  under  any  admissible  routing  policy  it 
holds  that 

pA  [v^o  >  x\  =  PA,i /k  b°o  >  x\  and  PA  [v^  >  x]  =  PA,0  boo  >  x\ .  (73) 

Proof.  Conclusion  (73)  follows  immediately  from  (71)  by  noting  that  P  [//' i  =  =  0 

and  P  [oB1  =  z/(f]  =  1/K.  ■ 

Observe  that  (71)  can  be  explained  by  considering  the  light  traffic  situation  where  at 
most  one  more  customer  and  the  tagged  customer  join  the  system.  These  two  customers 
are  assigned  to  different  queues  with  probability  1  —  a,  in  which  case,  from  the  tagged 
customer’s  perspective,  any  routing  policy  is  tantamount  to  Round-Robin  routing.  On  the 
other  hand,  with  probability  a,  both  customers  are  assigned  to  the  same  queue,  in  which 
case  the  system  behaves  like  an  M\G\1  queue.  Thus,  up  to  first  order  in  A,  the  end-to-end 
delay  performance  under  any  routing  policy  is  a  mixture  of  these  two  components.  Such  an 
interpretation  is  confirmed  upon  comparing  the  corresponding  terms  in  (71)  with  the  known 
expansion  for  the  M\G\1  queue  [9,  p.  201]  and  the  expression  in  (73)  for  Round-Robin 
routing.  The  details  are  given  in  Appendix  A.4. 

Proposition  11.1  leads  to  the  conclusion  that  in  light  traffic  the  Round-Robin  policy 
is  an  optimal  routing  policy,  although  this  optimality  is  shared  by  a  number  of  policies, 
namely  all  the  admissible  policies  for  which  a  =  0. 

Corollary  11.2  In  the  setup  of  Proposition  11.1,  it  holds  that 

lim  i  (P x,a  boo  >  x]  -  PA  o  boo  >  s])  >  0,  x  >  0.  (74) 

AJO  A 

In  other  words,  Round  -  Robin  is  optimal  among  all  admissible  routing  policies  in  the  sense 
that  t,’b  <st  Voo  asymptotically  in  light  traffic. 


Proof.  Fix  x  >  0.  Inequality  (74)  follows  from  (7 1)  as  we  get 

lim  \  (PA  a  boo  >  x]  -  PA,0  boo  >  £]) 

AJ.0  A 


=  a  (  E 


poo  rx 

.  [a]  G(x)  -  G{x)  /  G(y)  dy  -  G( a 

J  x  Jo 


>  a  (  E  [a]  G(x)  —  G(x)  /  G(y)  dy  —  G(x) 


~  y)G(y)  dy^j 
G{y)  dy^j  =  0 
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Figure  1:  Expected  end-to-end  delay;  Bernoulli  vs  Round-Robin  routing;  K  =  10 
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by  the  monotonicity  of  G.  The  ensuing  stochastic  comparison  is  a  consequence  of  identifi¬ 
cation  (73).  ■ 


12  Simulation  results 

To  illustrate  the  asymptotic  optimality  of  Round  -  Robin  policy  we  present  numerical  ex¬ 
amples  comparing  a  system  of  parallel  queues  with  Round-Robin  routing  to  a  system  with 
Bernoulli  routing.  In  all  the  examples  shown  below  customers  arrive  to  the  parallel  queue¬ 
ing  system  according  to  a  Poisson  process.  We  perform  simulation  experiments  using  three 
different  distributions  for  the  service  time  rv  a.  In  particular,  we  consider,  in  order  of 
increasing  variability,  the  deterministic  distribution  D(x )  —  1  (x  >  1),  the  exponential 
distribution  £{x)  =  1  —  e~x  ( x  >  0),  and  the  hyperexponential  distribution  (mixture  of 
three  exponentials)  given  by 

3 

H{ x )  =  ^2pi(  1  —  e-3^),  x  >  0 
1=1 

with  pi  =  0.3,  p2  =  0.6,  P3  =  0.1,  and  f\  =  0.2,  f%  =  0.5,  fy  =  6.4,  yielding  a  squared 
coefficient  of  variation  <?H  =  7.516.  In  all  three  cases  the  expected  service  time  is  equal  to 
one. 

In  Figure  1  we  vary  the  Poisson  arrival  rate  A  and  plot  the  expected  end-to-end  delay, 
times  (1  —  p),  against  the  system  utilization  p,  for  a  system  of  IT  =  10  parallel  queues 
with  resequencing.  We  see  that  the  expected  end-to-end  delay  under  Round-Robin  rout¬ 
ing  is  smaller  than  its  counterpart  under  Bernoulli  routing:  This  conclusion  holds  for  all 
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three  service  distributions  and  across  all  traffic  intensities,  not  just  in  heavy  or  light  traffic. 
Tables  1  and  2  show  that  such  a  comparison  remains  true  when  we  vary  the  number  of  par¬ 
allel  queues  from  K  =  2  to  K  =  10.  We  conjecture  that,  for  the  case  of  Poisson  arrivals, 
a  comparison  in  the  increasing  convex  stochastic  ordering  between  the  end-to-end  delays 
under  Round-Robin  and  Bernoulli  routing,  holds  true  across  all  traffic  intensities.  Figure 
1,  together  with  Tables  1  and  2,  provide  evidence,  though  circumstantial,  in  support  of  this 
conjecture.  It  is  also  worthwhile  to  note,  from  Table  2,  that  in  the  case  of  deterministic 
service  times  the  end-to-end  delay  under  Round-Robin  routing  is  a  decreasing  function  of 
the  number  K  of  parallel  queues  (while  it  is  eventually  increasing  in  the  limit  as  K  grows 
unboundedly  for  all  other  distributions).  This  is  due  to  the  fact  that,  in  the  case  of  deter¬ 
ministic  service  times,  customers  experience  no  resequencing  delay  under  Round-Robin 
routing.  Furthermore,  their  Erlang  interarrival  times  to  each  queue  tend  to  deterministic  of 
duration  E  [a]  / p  as  K  increases  to  infinity. 


Expected  end-to-end  delay  E  v ^ 


p 

Service  d.f. 

K  =  2 

K  =  4 

K  =  6 

K  =  8 

K  =  10 

D 

1.26 

1.30 

1.33 

1.37 

1.40 

0.3 

£ 

1.67 

2.00 

2.31 

2.59 

2.79 

H 

4.27 

6.78 

8.69 

10.5 

12.1 

D 

2.58 

3.14 

3.52 

3.91 

4.16 

0.7 

£ 

4.84 

6.10 

7.22 

8.11 

8.66 

H 

17.6 

25.9 

31.6 

36.2 

39.1 

Table  1 :  End-to-end  delay  under  Bernoulli  routing. 


A  Appendix 


A.l  A  proof  of  Lemma  7.1 

Fix  r  =  1,2,...  and  k,  t  =  1, . . .  ,  K.  We  start  with  the  obvious  decomposition 


~r—  1 

r—  1 

r—  1  r—  1 

cov 

um.am 

=  EEcov 

uknoni  uemam 

_n= 0 

m= 0 

71=0  771=0 

Fixing  n,  m  =  0, 1, . . .,  we  note  under  the  independence  in  Assumption  (A)  that 


k  i 

^71^715  ^771^771 

=  E 

k  t 

-E 

^71^71 

E 

i 

(A.l) 
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Table  2:  End-to-end  delay  under  Round-Robin  routing. 

—  E  unum  E  ['X/;(7rn]  E  un  E  um  E  [cn]  E  [crm] 

=  E  u^u^n  ^b'(n,  m)E  [cr2]  +  (1  -  5(n,  m))E  [cr]2^ 

-E  III*]  E  \uem  1  E  [cr]2 

=  8(n,m) E  u^uem  var  [a]  +  cov  u^,uem  -E[ct]2. 

Moreover,  it  is  also  the  case  that 

S(n,m) E  =  6(n,m) E  u„uen 

=  8(n,m)S(k,£) E  u * 

=  S(n,m)S(k,e)^,  (A.2) 

so  that 

cov  u^an,uemam  =  8(n,m)5(k,£)VA1  +  cov  u^,uem  -E[cr]2.  (A.3) 

J  K  L  J 

Substituting  (A.3)  into  (A.l)  yields 

~r—  1  r—  1 

COV 

_n= 0  m= 0 

=  <*(&,  £)r  •  +  E  [ct]2  •  ^  ^  cov 

n=0  ra=0 

=  S(k,  l)r  ■  va1^  +  E  [cr]2  •  cov  Y  un,  Y  u ™  •  (A-4) 

|_n=0  m=0 
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It  is  now  plain  that  the  K  x  K  covariance  matrix  T  at  (37)  exists  if  and  only  if  the  I\  x  K 
covariance  matrix  F  at  (40)  exists,  in  which  case  the  relation  (41)  is  immediate.  This  con¬ 
cludes  the  proof  of  Lemma  7.1.  ■ 


A.2  A  proof  of  Proposition  8.1 


Bernoulli  routing:  Under  Bernoulli  routing,  the  FCLT  (36)  is  essentially  the  K -dimensional 
version  of  Donsker’s  Theorem  [3,  Thm.  16.1,  p.  137]  when  applied  to  the  i.i.d.  rvs 
{unan,  n  =  0, 1, . . .}.  In  order  to  determine  the  form  of  Ts,  fix  =  1, . . . ,  K.  For 
arbitrary  n,m  =  0, 1, . . .,  by  independence  we  note  that 


cov 


uB,k  uB'e 

un  i  um 


5(n,  m) cov 


B,k  B,l 
un  i  an 


6(n,  m)8(k,  £) 


(A.  5) 


Expression  (42)  readily  follows  upon  using  (A.5)  in  the  right-hand  side  of  relation2 


1 

-cov 

r 


_n= 0  m= 0 


1 

r 


r—  1  r—  1 

^^cov 

7i=0  m=0 


U 


B,k 
n  i 


U 


B,e 
m  7 


r  =  1,2,... 


and  then  letting  r  go  to  infinity. 

Round-Robin  routing:  Fix  r  =  1, 2, . . .  and  t  >  0.  We  begin  by  rewriting  (35)  as 


UR'r(t) 


•EH 


(A.  6) 


where  the  1RA -valued  process  {Zr(t).  t  >  0}  is  defined  componentwise  by 


[rt]  —  1 

zr'k(t )  :=  -=  V  1  [uR  =  k ]  (an  -EH),  t  >  0,  k  =  1, 2, . . . ,  K  (A.7) 

with  routing  rvs  {//A,  n  =  0, 1, — }  given  by  (6).  The  arguments  proceed  along  a  number 
of  steps. 

Step  1:  Fix  r  =  1,2,...  and  t  >  0.  For  each  k  =  1, . . . ,  K,  we  note  that 


[H 

I< 


M-i 

n= 0 


U 


R,k 


[rt] 

<y+i. 


This  relation  was  used  already  on  the  way  to  (A.4). 


(A.  8) 
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whence 


1  1 


M-i 


n= 0 


<  _  V  uR’k  -  —  < _ — 

l  n  K  I  ~  -  /T 


It  is  now  immediate  that  for  each  T  >  0, 


lim  sup  max 

i — *-°o  ( )<t<T  k=l,...,K 


[rt\- 1 

—  y 

y/r  “ 

v  n=0 


n  I< 


(A.9) 


=  0. 


(A.  10) 


Consequently,  by  Theorem  4.1  in  [3,  p.  25],  the  desired  convergence  (36),  with  covariance 
matrix  as  in  (43),  will  hold  if  we  show  instead  the  convergence 


t>  o}  {(rR)V2A(t),  t  >  o} 


(A.ll) 


where  {A(t)  ,  t>  0}  is  a  A'-dimcnsional  standard  Brownian  motion,  and  r/;  is  the  K  x  K 
covariance  matrix  given  by 


r =  k,  £  =  1, . . . ,  I\, 

where  we  have  taken  into  account  (41). 

Step  2:  Fix  r  =  1,2,...  and  k,£  =  1, . . . ,  K.  We  have 


1 


-COY 


r—  1 


r—  1 


u: 


Rt 


=  E 


E  ^ -  E 

Ln=0  m=0 

--  1 

\  n= 0 


K 


'  i  l  1  ' 

_  V  UR’£  -  — 

r  A-  m  A 
,  m=0  / 


(A.  12) 


(A.  13) 


upon  using  the  stationarity  assumption  on  the  assignment  sequence  (with  (5)).  Let  r  go  to 
infinity  in  (A.  13)  and  observe  from  (A.9)  (with  t  =  1)  that 


(A.  14) 


We  readily  conclude  from  definition  (40)  that  VRf  =  0  by  the  Bounded  Convergence  Theo¬ 
rem  (with  the  help  of  bounds  (A.8)  with  t  =  1).  This  establishes  (A.  12)  via  (41). 

Step  3  :  We  now  turn  to  showing  (A.ll).  A  moment  of  reflection  should  convince  the 
reader  that  for  each  k  =  1,2. ...  .K ,  conditionally  on  iZ  =  vR  =  k,  the  K  processes 
{Zr’\t),  t  >  0},  . . .,  {Zr,K (t),  t  >  0}  are  mutually  independent  for  each  r  =  1,2, . . .. 
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Appealing  to  the  cyclical  nature  of  the  Round-Robin  policy,  we  readily  conclude  to  the 
convergence 


{Zr(t),  t  >  0}  =*r  |  t  >  o|  ,  (A.15) 

conditionally  on  Vq  =  k.  This  is  an  easy  consequence  of  Donsker’s  Theorem  [3,  Thm. 
16.1,  p.  137];  details  are  left  to  the  interested  reader.  As  the  limit  in  (A.15)  does  not  depend 
on  k,  it  follows  that  this  convergence  holds  unconditionally  as  well !  This  last  convergence 
is  essentially  (A.  1 1)  as  we  recall  the  expression  (A.  12)  for  T^.  ■ 


A.3  A  proof  of  Proposition  9.2 

Clearly,  {S(t).  t  >  0}  is  a  zero  drift  A' -dimensional  Brownian  motions,  so  that  S(t\ , . . . ,  tn) 
are  n/v -dimensional  zero  mean  Gaussian  rvs.  Their  nK  x  nK  covariance  matrix  has  a 
block  structure  with  the  (i,j)  block  being  the  K  x  K  matrix  given  by 

min(fj,tj)S,  i,j  =  1, . . .  ,n,  (A.16) 

with  the  K  x  K  matrix  S  as  in  Proposition  8.2.  With  Proposition  9.1  in  mind,  we  see  that 
the  extremal  property  (58)  of  Round-Robin  routing  will  be  established  if  we  show  that  the 
matrix  difference 


C{ti,...,tn)  :=  cov[S(ti, . . . ,  tn)\  —  cov[SR(ti, . . .  ,in)] 

is  positive  semi-definite.  To  this  end,  write  an  arbitrary  element  v  in  1R"A  in  block  form  as 
v  =  (vi, . . . ,  vn)  with  Vi  a  vector  of  1RA  for  each  i  =  1, . . . ,  n.  We  need  to  show  that 

n  n 

vC(ti,.. .  ,tn)vT  =  ^  tj)  •  Vj(T,  -  T,R)vJ  >  0.  (A.  17) 

i= 1  7=1 

Expression  (47)  immediately  yields 

S  -  -  f  ■ •  E  [cr] 2  =  f  •  E  [a]2 

with  the  help  of  (43).  By  virtue  of  its  definition  (40),  the  matrix  T  is  itself  a  covariance 
matrix,  whence  is  positive  semi-definite.  Thus,  for  n  =  1,  we  have  that  (A.  17)  holds  as  it  is 
equivalent  to  T  being  positive  semi-definite. 

By  standard  results  from  linear  algebra  [17,  p.  339],  there  exists  a  K  x  K  orthonormal 
matrix  P  such  that  the  matrix  A  =  PI  P1  is  diagonal  with  non- negative  diagonal  elements 
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Ai, . . . ,  Xk ■  Making  the  change  of  variables  w,  =  v,P!  =  (w\, . . . ,  wf ),  or  equivalently, 
Vi  =  WiP,  for  each  i  =  1, . . . ,  n,  we  find 

n  n 

EE  min (ti,tj)  ■  WiPVPTwJ 

i=  i  j= i 

n  n 

yy  min(fj,  fj)  •  WiAwJ 
i=  1  i=l 

n  n  K 

yy  yy  mm(fj,  tj)  •  yy  xkw^w^ 

i= 1  .7=1  fc=l 

K  (  n  n  \ 

yyAfc  )  •  (A-18) 

fc=l  \t=l  i=l  / 

For  each  A:  =  1, . . . ,  A",  we  introduce  the  element  w\.  =  (u; , , . . ,  w^)  of  IRn  to  write 

n  n 

yy  yy  min(A,  =  wlcovlBfa, . . . ,  Ai)](™fc)T  (A.19) 

i=l  j=l 

where  covf/i(f] , . . .  ,tn)}  denotes  the  covariance  matrix  of  the  vector  Bit] , . . .  ,  tn)  := 

,  B(tn))  with  {B{t),  t  >  0}  a  standard  one -dimensional  Brownian  motion.  A 
covariance  matrix  being  positive  semi-definite,  each  of  the  terms  at  (A.  18)  is  non-negative, 
whence  (A.  17)  holds  by  virtue  of  the  fact  that  A-  >  0  for  all  k  =  1, . . . ,  AT.  ■ 


EM 


jvC{ti,...,tn)vT  = 


A.4  A  proof  of  Proposition  11.1 

Fix  x  >  0  and  take  =  1  [no  >  x\.  The  following  holds  irrespective  of  the  customer 
assignments  used:  First,  on  the  event  0,  we  have  vj  =  cjq,  so  that 

6(0)  =P[a>x]=  G(x).  (A.20) 

Next,  with  t  >  0,  on  the  event  {t}  it  is  also  the  case  that  vq  =  <to,  whence  <F({f})  =  <b(0), 
and  we  conclude  from  (70)  that 

±  m(o+)  =  J°  (6({t})  -  6(0))  dt.  (A.21) 

Finally,  fix  t  <  0  and  observe  that 

no  =  max  ([S(k,  v_ \)a  +  t]+  +  5{k,  r'oVo)  .  (A.22) 

k=l,...,K 
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The  remainder  of  the  proof  consists  in  evaluating  <b({t})  (t  <  0)  through  (A.22).  On 
the  event ic_  ]  /  i/q  (this  is  tantamount  to  Round-Robin  routing),  (A.22)  becomes 

v0  =  max  ([<7  +  t]+,  (j0)  ,  (A.23) 

while  on  the  event  zy_i  =  (which  corresponds  to  the  M\G\1  queue),  it  holds  that 

r;0  =  [cr  +  f]+ +  cr0.  (A.24) 

Using  this  information,  by  the  definition  (72)  for  a  and  the  admissibility  of  the  routing 
poilicy,  we  get 

$({£})  =  oP  [[cr  +  t]+  +  do  >  x\  +  (1  —  a)P  [max  ( [cr  +  t]+ ,  cr0)  >  x\  (A.25) 

with 

P  [max  ( [cr  +  f]  +  ,  cr0)  >  x]  =  1  —  P  [op  <  x\  P  [[cr  +  t]  +  <  x\ 

=  1  —  P  [cto  <ic](l  —  F*[cT-|-t>rc]) 

=  1  —  G(x)  (l  —  G(x  —  f)) 

=  G(x)  +  G(x)G(x  —  t).  (A.26) 

Next,  recalling  (A.20),  we  find 

$({*})  -  $(0) 

=  aP  [[rr  +  t]+  +  Jo  >  %\  +  (1  —  a)  (G(x)  +  G(x)G(x  —  t ))  —  G(x) 

=  a  (P  [[<j  +  t]+  +  uq  >  x\  —  G(x))  +  (1  —  a)G(x)G(x  —  t)  (A.27) 

with  the  help  of  the  calculations  leading  to  (A.26).  We  further  write 

P  [[u  +  f]+  +  (j0  >  x]  -  G(x)  =  P  [cr0  <  x  <  [a  +  t]+  +  cr0] 

=  E  [l  [<jo  <  x]  G(x  —  Jo  —  t)\  ,  (A.28) 

and  reporting  (A.27)  and  (A.28)  into  (A.21),  we  obtain 

^<0+> 

p  oo  poo 

=  (1  -  a)G(x)  /  G(y)  dy  +  a  E  [l  [cr0  <  x\  G{x  -  cr0  +  2/)]  dy. 

J  x  Jo 
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Expansion  (71)  now  follows  once  we  observe  that 


since  G(0)  =  0. 


E  [l  [cr0  <  x]  G(x  -  d0  +  y)]  dy 
dy  f  dG(z)G(x  -  z  +  y) 

Jo 

p  oo 

dG(z)  /  G(y)  dy 

J  x  —  z 

/*  QQ  /» 

dG{z)  /  G(y)  dy-  dG(z)  I 

Jo  Jo  J 

px  r%—y 


G{y)  dy 


E  [d]  G(x)  -  /  G(y)  dy 


i  o 


/  0 


dG(z) 
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